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DETAILED ACTION 



In view of the appeal breif filed on December 10 th 2009, PROSECUTION IS 
HEREBY REOPENED. A new rejection is set forth below. 

To avoid abandonment of the application, appellant must exercise one of the 
following two options: 

(1 ) file a reply under 37 CFR 1.111 (if this Office action is non-final) or a reply 
under 37 CFR 1.113 (if this Office action is final); or, 

(2) initiate a new appeal by filing a notice of appeal under 37 CFR 41 .31 followed 
by an appeal brief under 37 CFR 41 .37. The previously paid notice of appeal fee and 
appeal brief fee can be applied to the new appeal. If, however, the appeal fees set forth 
in 37 CFR 41 .20 have been increased since they were previously paid, then appellant 
must pay the difference between the increased fees and the amount previously paid. 

A Supervisory Patent Examiner (SPE) has approved of reopening prosecution by 
signing below: 

/Sumati Lefkowitz/ 



Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 
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Claims 1, 3, 8-10, 12, 14-19 and 21 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Yamazaki (US 2002/0079512) in view of Ikeda (US 
2001/0020939). 

Regarding Claims 1 and 16, Yamazaki teaches a scanning display apparatus 
and method of operation (Yamazaki, Fig. 1 scanning display) comprising: 

(a) a display operable: 

(i) to receive one or more driver signals and generate corresponding visual 
information for presentation on the display (Yamazaki, Fig. 1 display portions receive 
driver signals and generate images); and 

(ii) to sense radiation received at the display and generate one or more 
sensing signals corresponding to a region proximate to the display (Yamazaki, Fig. 1 
sensing portion senses radiation from pen); and 

(b) computer hardware coupled to the display for generated the one or more 
driver signals for the display and for receiving the one or more sensing signals from the 
display (Yamazaki, Fig. 1 source and gate drivers), the computer hardware being 
operable to provide an interactive use interface at the display (Yamazaki, Figs. 15A-B 
and21A-B); 

Yamazaki fails to teach that the apparatus is configured to sense objects and 
adapt the visual information of the display as claimed. 

Ikeda teaches an apparatus which is configured to sense one or more objects 
when placed on or positioned in proximity to the display and obscuring at least part of 
the visual information displayed on the display (Ikeda, Figs. 35-38, sliding body blocks 
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part of the display), and to adapt the visual information for display on the unobscured 
parts of the display which are unobscured by the one or more objects (Ikeda, Figs. 35- 
38, display is adapted to show visual information in unobscured area). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to add the de-energizing feature of Ikeda to the display device of Yamazaki in 
order to reduce power consumption. 

Regarding Claims 3 and 17, Yamazaki further teaches that the display is 
operable to generate light radiation for illuminating the one or more objects placed in 
proximity to or on the display (Yamazaki, paragraph [0053]) and also for receiving at 
least part of the light radiation reflected from the one or more objects so as to enable 
the apparatus to assimilate a scanned image of the one or more objects (Yamazaki, 
paragraph [0053]). 

Regarding Claim 8, Yamazaki in view of Ikeda further teaches presenting the 
user interface in squeezed format when an unobscured active region of the display is 
insufficiently large to include the entire user interface (Ikeda Figs. 35-38). 

Regarding Claim 9, Yamazaki in view of Ikeda further teaches that the user 
interface includes a scrolling feature for use in accessing squeezed parts of the user 
interface presented on the display (Ikeda, Fig. 36A-B directional buttons). 

Regarding Claim 10, Yamazaki in view of Ikeda further teaches a minimum 
display size limit for the user interface is defined in the computer hardware such that 
obscuring more of the display than defined by the display size limit causes the computer 
hardware to present at least part of the user interface in a squeezed format (Ikeda Figs. 
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35-38 limit is 100% revealed. If less than 100% revealed then display a squeezed 
portion of the display). 

Regarding Claim 12, Yamazaki further teaches that the computer hardware in 
conjunction with the display is operable to identify one or more objects in proximity to or 
in contact with the display and invoke one or more corresponding software application 
for executing in the computer hardware in response to placement of the one or more 
objects (Yamazaki, paragraph [0178]). 

Regarding Claim 14, Yamazaki further teaches wherein the display comprises 
one or more pixel devices capable of both: 

(a) generating or transmitting illumination (Yamazaki, Fig. 1 display portion 
transmits light); and 

(b) sensing illuminating incident thereupon (Yamazaki, Fig. 1 sensing portion 
senses radiation from pen), the one or more pixel devices being fabricated using one or 
more of: 

(c) liquid crystal display device with associated TFTs configured to function as a 
light sensor (Yamazaki, paragraph [0034-0035]). 

Regarding Claim 15, Yamazaki further teaches the display apparatus of claim 1 
adapted for using in computer monitors (Yamazaki, paragraph [0391]). 

Regarding Claim 18, Yamazaki in view of Ikeda fails to teach wherein the visual 
information is adapted so that all the visual information are displayed on the unobscured 
parts. However the examiner takes official notice that it is well known in the art at the 
time of the invention to shift text around so that text can be rearranged on the display 
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screen according to the shape and size of the screen so that all of the information can 
be displayed. It would have been obvious to one of ordinary skill in the art at the time of 
the invention to allow all of the information to be displayed in order to better utilize the 
full extend of the unobscured area of Yamazaki in view of Ikeda (Ikeda, Figs. 36A, 36B). 

Regarding Claim 19, Yamazaki in view of Ikeda inherently teaches wherein the 
computer hardware is configured to form a halo surrounding a footprint of the one or 
more objects to provide an indication of sensing the one or more object, and wherein 
the computer hardware is configured to removed the halo upon removal of the one or 
more objects from the proximity of the display (Ikeda, Figs. 36A and 36B, specifically 
since half the display is turned off the edge of the top half of the display is turned on can 
be considered a halo for the purposes of the claimed invention, as can be seen from the 
applicant's own disclosure, the halo need not completely surround the object, only 
bordering the object). 

Regarding Claim 21, Yamazaki further teaches wherein the computer hardware 
is configured to determine an identity of a user from detection of the one or more 
objects, and to present preferred visual information preferred by the user (Yamazaki, 
Fig. 21 A paragraphs [0397-400]). 

Claim 2 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Yamazaki (US 2002/0079512) in view of Ikeda (US 2001/0020939) as applied to Claims 
1,3,4, 8-10, 12, 14-21 above, and further in view of Baur (US 5,610,629). 
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Regarding Claim 2, Yamazaki further teaches the apparatus being arranged to 
identify positions of the one or more objects placed in proximity of the display by way of 
input device illumination to the apparatus obscured by the one or more objects 
(Yamazaki, Fig. 1 sensing portions). 

Yamazaki in view of Ikeda fails to teach obscured ambient illumination as 
claimed. Baur teaches identifying position of one or more objects placed in proximity of 
the display by way of ambient illumination to the apparatus obscured by one or more 
objects (Baur, Col. 4 lines 20-28). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Yamazaki and Ikeda's display to identify positions using ambient 
illumination as well as input device illumination, as taught by Baur, in order to provide a 
more energy efficient mode of touch detection. 

Claim 4 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Yamazaki (US 2002/0079512) in view of Ikeda (US 2001/0020939) as applied to claims 
1,3, 8-10, 12, 14-19 and 21 in further view of Masters (US 6429857 B1). 

Regarding Claim 4, Yamazaki fails to teach that the computer hardware is 
operable to execute a first coarser scan to determine spatial location of the one or more 
objects on or in proximity to the display, and then execute a finer scan to assimilate finer 
details of the one or more objects. 

Masters teaches a coarse scan operated after a fine scan (Masters, Figs. 5 and 
6). The examiner notes that the touch screen technology is not the same, however the 
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principle of operating a coarse scan and a fine scan in a touch screen environment is 
taught by Masters and can easily be applied to the device of Yamazaki simply by 
omitting sensing elements. It would have been obvious to one of ordinary skill in the art 
at the time of the invention to use a coarse and then a fine scan as taught by Masters in 
the system of Yamazaki and Ikeda in order to increasing the speed and accuracy of the 
scanning system. 

Claim 20 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Yamazaki (US 2002/0079512) in view of Ikeda (US 2001/0020939) as applied to claims 
1, 3, 8-10, 12, 1 4-1 9 and 21 above, and further in view of Masters (US 6429857 B1 ) and 
Baur(US 5,610,629). 

Regarding Claim 20, Yamazaki in view of Ikeda fails to teach wherein the 
computer hardware is configured to perform a coarse scan using illumination to identify 
position of the one or more objects a fine scan, which is finer than the coarse scan, to 
identify details of the one or more objects using illumination generated by the display. 

Masters teaches a coarse scan operated after a fine scan (Masters, Figs. 5 and 
6). It would have been obvious to one of ordinary skill in the art at the time of the 
invention to use a coarse and then a fine scan as taught by Masters in the system of 
Yamazaki and Ikeda in order to increasing the speed and accuracy of the scanning 
system. 

Yamazaki in view of Ikeda fails to teach obscured ambient illumination as 
claimed. Baur teaches identifying position of one or more objects placed in proximity of 
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the display by way of ambient illumination to the apparatus obscured by one or more 
objects (Baur, Col. 4 lines 20-28). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Yamazaki and Ikeda's display to identify positions using ambient 
illumination as well as input device illumination, as taught by Baur, in order to provide a 
more energy efficient mode of touch detection. 

Claim 5 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Yamazaki (US 2002/0079512) in view of Ikeda (US 2001/0020939) as applied to Claims 
1,3,8-10,12,1 4-1 9 and 21 above, and further in view of Yamamoto (US 5,742,279). 

Regarding Claim 5, Yamazaki in view of Ikeda fails to teach that the computer 
hardware is operable to present a representation of the one or more objects in a region 
of the display in which the one or more objects were placed during scanning as 
confirmation of successful completed scanning. 

Yamamoto teaches computer hardware operable to present a representation of 
the one or more objects in a region of the display in which the one or more objects were 
placed during scanning as confirmation of successful completed scanning (Yamamoto, 
Col. 2 lines 15-22). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to add the presentation system of Yamamoto to the display system of 
Yamazaki in view of Ikeda in order to provide active feedback to the user as it relates to 
scanning. 
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Claim 11 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Yamazaki (US 2002/0079512) in view of Ikeda (US 2001/0020939) as applied to Claims 
1 , 3, 8-1 0,12,1 4-1 9 and 21 above, and further in view of Breen (US 200401 1 7735 A1 ). 

Regarding Claim 11, Yamazaki teaches a scanning display apparatus and 
method of operation (Yamazaki, Fig. 1 scanning display) comprising: 

(a) a display operable: 

(i) to receive one or more driver signals and generate corresponding visual 
information for presentation on the display (Yamazaki, Fig. 1 display portions receive 
driver signals and generate images); and 

(ii) to sense radiation received at the display and generate one or more 
sensing signals corresponding to a region proximate to the display (Yamazaki, Fig. 1 
sensing portion senses radiation from pen); and 

(b) computer hardware coupled to the display for generated the one or more 
driver signals for the display and for receiving the one or more sensing signals from the 
display (Yamazaki, Fig. 1 source and gate drivers), the computer hardware being 
operable to provide an interactive use interface at the display (Yamazaki, Figs. 15A-B 
and21A-B); 

the apparatus being arranged to present the user interface comprising a plurality 
of user interface features (Yamazaki, Fig. 15A-B, 21A-B). 

Yamazaki fails to teach that the computer hardware is provided with a priority 
identifier for each of the features for determining which of the features to omit from the 
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presentation in the user interface in a situation where at least part of the display is 
obscured. 

Ikeda teach computer hardware provided with an identifier for parts of the display 
screen including certain sections of the GUI for determining which of the sections to 
omit from the presentation in the user interface in a situation where at least part of the 
display is obscured (Ikeda, Figs. 35-38). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to add the omitting feature of Ikeda to the display device of Yamazaki in order 
to reduce power consumption. 

Yamazaki in view of Ikeda fails to teach a priority identifier for each of the 
features as claimed. 

Breen teaches using a priority identifier for each of the features for determining 
which features to omit from an image when the image is cropped (Breen, Figs. 2 and 4). 

It would have been obvious to add the priority identifier to the display system of 
Yamazaki as modified by Ikeda in order to allow for prioritized cropping of the displayed 
area as taught by Breen in order to provide the most important user interface items to 
the user when there is limited space on the display screen. 

Claim 13 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Yamazaki (US 2002/0079512) in view of Ikeda (US 2001/0020939) as applied to Claims 
1 , 3, 8-1 0, 1 2, 1 4-1 9 and 21 above, and further in view of Macinnes (WO 00/75766). 
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Regarding Claim 13, Yamazaki in view of Ikeda fails to teach animated icons as 
claimed. Macinnes teaches one or more software application are operable to generate 
one or more animated icons on the display which appear in surrounding spatial 
proximity to the one or more objects placed on the display, whereby providing a visual 
acknowledgement that the computer hardware has identified presence of the one or 
more objects (Macinnes, Fig. 5). 

It would have been obvious to add the animated icons as taught by Macinnes to 
the display system of Yamazaki in view of Ikeda in order to provide active visual 
feedback to the user when and input is made thus avoiding accidental selection of an 
undesired selectable option (Macinnes, pg. 3 last paragraph). 

Response to Arguments 

Applicant's arguments filed September 28 th 2009 have been fully considered but 
they are not persuasive. 

The applicant argues that with regards to claim 1 , Yamazaki in view of Ikeda fails 
to teach "obscuring at least part of the visual information displayed on the display, and 
to adapt the visual information for the display on the unobscured parts of the display 
which are unobscured by the one or more objects". The examiner respectfully 
disagrees. Specifically the examiner would like to point that the claims do not recite that 
the same visual information needs to be displayed by both the unobscured and the 
obscured parts of the display but merely specifies that "the visual information" is 
displayed and not what part of that visual information is displayed. Ikeda teaches 
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cropping part of the overall image, "the visual image" as in the entire image is displayed 
when the display is unobscured, and is partially displayed when part of the image is 
obscured. Further the claims and specification fail to define exactly what adapt means. 
The examiner is interpreting adapting as any form of change, therefore cropping can 
easily be interpreted as adapting. 

The applicant further argues regarding claim 8, that Yamazaki in view of Ikeda 
fails to teach "squeezed format". However the applicant has failed to define exactly 
what squeezed format is. Therefore since, the area of the obscured display is smaller 
than the normal display it can be considered squeezed, wherein the user interface is 
cropped or "squeezed" to a certain sized as defined by the obstruction. 

Applicant's arguments with respect to claims 4, 1 1 and 20 have been considered 
but are moot in view of the new ground(s) of rejection. 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Ke Xiao whose telephone number is (571)272-7776. 
The examiner can normally be reached on Monday through Friday from 8:30AM to 
5:00PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Sumati Lefkowitz can be reached on (571) 272-3638. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Sumati Lefkowitz/ 

Supervisory Patent Examiner, Art Unit 2629 



/Ke Xiao/ 

Examiner, Art Unit 2629 



